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Clearance  services  regarding  outgoing  or  graduating  students  are 
deficient  in  most  academic  web  portals  and  the  few  existing  are  prone 
to  serious  usability  challenges.  A  framework  for  a  cybernated 
clearance  portal  was  proposed  and  implemented  as  an  integral 
prototype  system  of  the  object  study.  Data  were  gathered  and 
evaluated  using  a  survey-based  usability  evaluation  method.  The 
resulting  system  was  then  evaluated  by  selected  number  of 
participants  to  determine  its  usability  level  in  terms  of  effectiveness, 
efficiency,  and  satisfaction.  Results  indicated  that  participants  of  the 
experiment  were  of  the  perception  that  the  system  was  satisfactorily 
easy  to  use  with  an  average  mean  of  7.37  portraying  the  system 
usability  satisfaction  rate  with  the  ‘‘Easy”  level.  This  further 
affirmed  that  the  developed  system  was  easy  to  use  (effective), 
facilitates  task  completion  (efficient),  and  was  preferred  to  their 
existing  rigorous  approach  of  executing  graduate’s  clearance 
services. 


https://nipesjournals.org.ng 
©  2020  NIPES  Pub.  All  rights  reserved 


1.  Introduction 

Most  academic  institutions  have  become  organizationally  productive  with  the  use  of  web  portal 
technologies  in  serviees  involving  students’  admission,  registration,  payment,  clearance,  reeords, 
results  and  many  more  [1,  2,  3].  Clearance  in  particular,  is  required  for  both  entry  and  outgoing 
students  in  all  academic  institutions.  In  so  doing,  web  portal  technologies  have  been  adopted  towards 
managing  students  related  services. 

Despite  the  technologieal  efforts,  graduating  students’  clearanee  has  remained  manual  in  most 
tertiary  institutions  and  this  has  ventured  the  advocacy  of  automating  the  processes  in  learning 
institutions.  A  recent  study  revealed  the  development  of  a  few  clearance  systems  but  mostly 
relegated  to  the  non-use  category  [4].  Developing  a  web  portal  system  particularly  for  student 
information  management  without  considering  the  ease  to  use,  learn  and  complete  a  task  results  to 
serious  usability  challenges  [5].  Usability  factor  is  a  vital  determinant  that  may  influence  users’ 
intentions  to  use  a  software  application  or  product  and  should  be  evaluated  when  developing 
academic  clearance  systems.  Owing  to  this,  this  paper  first,  explored  background  information  and 
proposes  a  framework  in  section  2.  Section  3  designed  and  implemented  the  framework  as  a 
prototype  module  for  integration  into  the  observed  institutions  web  portal.  This  developed  prototype 
was  evaluated  and  results  were  discussed  with  respect  to  usability  factors  ascertaining  its 
effectiveness,  efficiency  and  satisfaction  in  section  4,  and  thereafter  concluded  in  section  5. 
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2.  Background  Knowledge 

Universities  are  now  confident  in  web  technologies  as  institutional  tools  to  manage  all  students 
related  activities.  Clearance  activities  are  now  managed  via  web  portal  technologies,  and  these 
technologies  have  overtime  proven  to  be  significant  as  tools  for  complex  amount  of  student  data 
management.  Studies  have  shown  that  clearance  is  a  vital,  hectic  and  tedious  exercise  for  both  entry 
and  outgoing  students  and  efforts  have  been  advocated  toward  automating  graduating  students’ 
clearance  processes  with  the  development  of  web  applications  [2,3,6,7,8].  It  is  still  a  grey  area  to 
ascertain  the  usability  of  these  developed  applications  as  Eti  [4]  argued  that,  they  have  either  been 
neglected  or  relegated  to  the  background.  The  non-acceptance  nor  usage  issue  is  bound  to  usability 
challenges  that  may  be  accrued  from  the  developer  perspectives  in  failure  to  consider  users 
preferences  at  design  stages  [9]  and,  several  usability  factors  including  the  system’s  efficiency, 
effectiveness,  satisfaction,  learnability,  etc.  [4,10,11,12]. 

Most  of  these  clearance  web  portals,  even  though  they  might  have  met  all  scientific  and  technical 
design  requirements  [5]  have  not  been  evaluated  against  system  usability  attributes:  effectiveness, 
efficiency  and  user  satisfaction  -  which  according  to  Aziz  [13],  is  the  ability  to  gauge  that  the  portals 
are  fulfilling  their  objectives  in  order  for  stakeholders  to  measure  planned  improvements  on  the 
portal  and  their  desired  impacts.  However,  usability  of  clearance  systems  needs  to  be  evaluated  to 
account  for  desired  impacts. 

Usability  is  the  measure  of  ease  with  which  a  system  can  be  learned  or  used,  its  safety,  effectiveness 
and  efficiency,  and  the  attitude  of  its  users  towards  it  [5].  The  ease  being  the  extent  to  which  a  web 
portal  system  can  be  used  by  students  or  staff  to  achieve  specific  tasks  with  effectiveness,  efficiency, 
rate  of  errors,  memorability  and  satisfaction  in  a  specific  context  of  use  [5,14,15,].  Usability  is  an 
important  determinant  of  quality  in  software  products,  as  it  has  overtime  been  established,  that  the 
success  or  failure  of  software  products  does  not  only  depend  on  a  completed  set  of  functionalities 
but  on  quality  which  is  evaluated  by  usability  [16,17,18].  Thus,  usability  ensures  that  a  system  must 
be  useful,  usable  and  used.  In  this  paper,  a  framework  was  proposed,  implemented  and  the 
developed  prototype  was  a  cybernated  clearance  system  evaluated  with  regards  three  usability 
attributes  -  effectiveness,  efficiency  and  satisfaction.  The  proposed  framework,  design  and 
implementation  were  described  in  section  3  hereafter. 


3.  Methodology 

3.1.  The  Proposed  Conceptual  Framework 

The  proposed  conceptual  framework  for  the  clearance  system  depicted  in  Figure  1,  is  a  formal 
representation  of  the  intending  system  which  comprises  of  the  externally  visible  components  of  the 
system  organized  in  a  way  that  supports  implementation  of  the  overall  system.  It  depicts  the 
interactions  between  the  users  with  the  system,  how  information  is  generated  and  flow  through  the 
system.  The  observed  study  was  University  of  Benin  web  portal. 
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Figure  1.  A  Framework  for  a  Cybernated  Clearance  System 

The  model  consists  of  simple  diagrams  representing  entities  or  component  of  the  system  and  arrows 
showing  the  roles  or  activities  associated  with  each  entity.  The  clearance  processes  depicted  here, 
begins  with  the  system  admin  creating  users  account  for  each  departmental  clearance  officers  and 
thereafter,  the  clearance  staff  at  the  departmental  level  uploads  approved  graduating  students  list, 
and  students  can  then  go  to  the  clearance  module  to  register,  login,  check  clearance  requirement  and 
start  clearance  by  uploading  their  required  clearance  documents  as  depicted  in  Figure  2,  with 
approved  payment  clearance  records,  they  can  request  for  clearance  certificate  once  their  status  is 
deemed  cleared  by  clearance  officers.  On  the  other  hand,  each  departmental  clearance  officers  - 
Departmental  Clearance,  Faculty  Clearance,  Student  Affairs,  etc.  is  saddled  with  roles  to  facilitate 
the  process  from  one  stage  to  another.  Each  is  authorized  into  the  system  via  a  user  login 
accordingly.  The  system  generates  and  stores  records  in  the  database  in  order  to  produce  the 
expected  deliverables.  Deliverables  from  the  system  are  student’s  clearance  records,  certificates, 
printouts  amongst  others  as  they  apply  to  various  departments. 

3.2.  Information  Flow  Design 

Depicted  in  Figure  2  is  a  detailed  or  level  2  Data  Flow  Diagram  (DFD)  which  captures  the  flow  of 
information  and  entities  of  the  system  to  be  developed.  It  aids  the  description  of  processes  and 
information  flow  in  systems. 
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Figure  2.  A  Detailed  DFD  for  the  Proposed  Cybernated  Clearance  System 


The  design  is  made  up  of  several  entities,  processes  and  deliverables.  It  further  highlighted  the 
functionalities  of  the  framework  for  better  understanding  showing  the  flow  of  information,  the 
processes,  repositories  and  deliverables  towards  implementation  of  the  system. 

3.3.  Implementation  and  Deployment 

Technically,  implementation  entails  the  systematic  conversion  of  designs  into  a  working  system  via 
software  development  tools  and  testing  the  developed  cybernated  clearance  modules  according  to 
users’  preferences  or  needs.  Owing  to  this,  PHP,  a  server-side  scripting  language  for  building 
dynamic  web  pages  was  used  in  coding  scripts  which  were  embedded  into  HTML  source  documents 
and  interpreted  by  a  web  server  with  PHP  preprocessor  model.  Cascading  Style  Sheets  (CSS),  a 
style  sheet  language  was  used  for  describing  the  user  interfaces  and  layout  formatting  of  a 
documents  written  in  a  markup  language.  JavaScript  was  employed  for  the  systems  interactive 
interfaces  and  forms  validation,  and  to  support  content  production  for  all  modern  web  browsers 
without  plug-ins.  The  major  schema  objects  were  created  in  the  database  as  tables  to  store  clearance 
data  for  the  resultant  system  using  MySQL  as  a  custom  storage  engine.  The  database  was  fully 
accessed  using  PHP  connection  from  the  Application  Programming  Interface  (API)  to  the  backend 
provided  by  the  phpMyadmin  component  of  MySQL  Server.  Other  supporting  technologies  include: 
Bootstrap  frontend  framework,  JQuery.js,  Asynchronous  JavaScript  and  XML  (AJAX).  XAMPP  a 
cross  platform  server  technology  was  used  as  a  local  server  to  deploy  the  system.  A  home  interface 
of  the  developed  system  is  depicted  in  Figure  3. 
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Figure  3.  Home  Page  of  the  Cybernated  Clearance  Portal  system 
4.  Evaluation  and  Results 

The  evaluation  procedure  was  in  stages  involving  different  tasks  and  participants.  There  were  seven 
clearance  related  tasks  and  eighteen  participants  made  up  of  seven  departmental  clearance  officers 
and  eleven  students  of  various  faculties.  The  goal  was  to  examine  the  system’s  usability  and  the 
number  of  evaluators  (participants)  is  quite  adequate  in  range  with  regards  to  software  usability 
evaluation  [19,20]. 

Usability  testing  was  conducted  to  evaluate  the  ease  at  which  the  system  can  be  used  in  a  specific 
context.  It  was  measured  using  standard  metrics:  efficiency,  effectiveness  and  satisfaction  [5,18,21]. 
The  usability  experiments  were  explained  to  the  participants  with  guidelines  on  how  to  use  the 
system  to  complete  a  specific  task.  A  survey-based  usability  evaluation  method  was  adopted  [17] 
with  adapted  questions  scaling  from  1-10  representing  “very  difficult”  to  “very  easy”  in  order  to 
capture  usability  test  outcomes. 

Data  were  gathered  from  the  experiment  via  logs  of  the  participants  interactions  with  the  clearance 
system.  The  log  contained  details  of  each  participant  and  their  usability  ratings  on  different  tasks. 
Each  was  recorded  with  start  time,  finish  time  and  the  level  of  completeness  reached  with  every 
task.  Some  tasks  were  separately  handled  by  the  students  while  others  by  the  clearance  officials. 
The  results  of  the  evaluation  are  represented  in  tables  regarding  the  system’s  effectiveness, 
efficiency  and  users’  satisfaction. 

4.1.  Effectiveness 

Effectiveness  measures  the  outcome  of  the  participants  interaction  or  use  with  the  system.  In  this 
paper,  it  indicates  the  completion  rate.  The  participants  average  task  completion  rates  were  extracted 
and  presented  in  Table  1,  demonstrating  the  effectiveness  of  the  system. 


Table  1:  Task  Completion  Evaluation  Ratings 


Participants 

Usability 

Rate 

S/N 

Tasks 

Staff 

(Mean) 

Student 

(Mean) 

STD 

1 

Register  and  login 

6.7143 

6.5455 

1.3779 

6.6299 

2 

Upload  clearance  documents 

7.0000 

7.8182 

1.0553 

7.4091 

3 

Make  payments 

- 

4.8182 

2.0405 

4.8182 

4 

Edit,  save  or  view  clearance  status 

6.5714 

7.7273 

1.0178 

7.1494 
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5 

Validate  and  confirm  payments 

6.8571 

- 

0.8997 

6.8571 

6 

Issue,  request  and  print  clearance 

7.0000 

7.9091 

1.0416 

7.4545 

7 

Complete  clearance  task  and  logout  successfully 

7.2857 

8.0000 

0.9582 

7.6429 

Overall 

6.9048 

7.1364 

1.1987 

6.8516 

4.2.  Efficiency 

Efficiency  is  the  time  resources  used  by  participants  in  completing  a  task.  It  shows  the  time  to 
complete  each  task  and  it  can  be  calculated  in  two  ways;  time  based  and  overall  relative.  The  overall 
relative  was  adopted  in  this  paper  because  it  is  more  suitable  regarding  the  multiple  tasks.  The  time 
rate  at  which  each  task  was  completed  by  the  participants  was  obtained  using  the  Equation  (1)  [19]; 

Overall  Relative  Efficiency  (ORE)  =  ^  100%  (1) 

hi=ihj=i  tij 

From  Equation  (1):  N  is  the  tasks  to  be  completed,  R  is  the  number  of  participants,  ty  is  the 

completion  time  of  task  i  by  participant  j,  ny  is  the  outcome  of  task  i  by  participant];  ny  =  1:  if  the 

task  i  was  completed  by  all  participants  j,  otherwise  it  is  divided  by  the  number  of  those  who 

completed  theirs  over  the  entire  participants.  The  ORE  is  the  ratio  of  effective  users’  work  time  to 

all  users’  work  time  as  summarized  in  Equation  (1).  Thus: 

for  Task  1,  N  =  1,  R  =  18,  ny  =  1,  ty  =  1.23,  and  njytjy  =  1.23; 

for  Task  2,  N  =  1,  R  =  12,  ny  =  0.6667,  ty  =  2.5,  and  riijtij  =  1.6667; 

for  Task  3,  N  =  1,  R  =  11,  ny  =  0.6111,  ty  =  2.44,  and  riijtij  =1.4911; 

for  Task  4,  N  =  1,  R  =  18,  ny  =  1,  ty  =  1.33,  and  riijtij  =1.33; 

for  Task  5,  N  =  1,  R  =  7,  ny  =  0.3889,  ty  =  3.09,  and  nijtij  =1.2017; 

for  Task  6,  N  =  1,  R  =  18,  ny  =  1,  ty  =  1.38,  and  nijtij  =1.38; 

for  Task  7,  N  =  1,  R  =  18,  ny  =  1,  ty  =  1.49,  and  nijtij  =1.49; 

Zf=i  Zf=i  riijtij  =  9.78944;  5:f=i  I.j=i  Uj  =  13.49;  ORE  =  72.75% 

4.3.  Satisfaction 

Satisfaction  indicates  the  ease,  comfort  and  difficulty  at  which  participants  used  the  clearance 
system.  In  this  paper,  the  test  level  satisfaction  was  opted  for  using  the  post  task  questions.  Table  2 
captures  the  average  participants  post  system’s  satisfaction  ratings  on  usability  level. 


Table  2;  Satisfaction  Evaluation  Ratings 


Participants 

lasks 

Staff 

(Mean) 

Student 

(Mean) 

SID 

Mean 

Usability  Uevel 

1 

Overall  scale  on  Task  1 

8.0000 

7.8182 

0.9003 

7.9091 

Easy 

2 

Overall  scale  on  Task  2 

6.0000 

8.3636 

1.0299 

7.1818 

Easy 

3 

Overall  scale  on  Task  3 

- 

5.8182 

0.7506 

5.8182 

Moderate 

4 

Overall  scale  on  Task  4 

7.4286 

7.9091 

0.6691 

7.6688 

Easy 

5 

Overall  scale  on  Task  5 

7.5714 

- 

0.5345 

7.5714 

Easy 

6 

Overall  scale  on  Task  6 

7.8571 

7.8182 

0.7071 

7.8377 

Easy 

7 

Overall  scale  on  Task  7 

7.2857 

7.9091 

0.5941 

7.5974 

Easy 

Overall 

7.3571 

7.6061 

0.7408 

7.3692 

Easy 
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4.4.  Discussion  of  Results 

The  results  of  the  evaluation  were  presented  and  rated  with  the  Likert  scale  in  Table  3. 


Table  3.  Usability  Rating  Scale 


SN 

Average  Usability  Rating 

Indication 

1 

0.00  <UL<  2.00 

Very  Difficult 

2 

2.00  <UL<  4.00 

Difficult 

3 

4.00  <UL<  6.00 

Moderate 

4 

6.00  <  UL<  8.00 

Easy 

5 

8.00  <  UL<  10.00 

Very  Easy 

Table  1  shows  the  evaluation  ratings  for  task  completion  by  both  categories  of  the  participants.  The 
average  completion  rate  for  each  task  was  computed  for  both  the  clearance  officials  and  students. 
Results  revealed  that  the  task  of  making  payments  was  rated  moderate  with  an  average  rating  of 
4.82  -  an  indication  that  payment  is  not  directly  an  internal  component  of  the  system,  but  there  was 
an  indication  that  participants  were  most  comfortable  in  executing  a  clearance  task  and  logged  out 
successfully  with  an  average  rating  of  7.64.  With  a  standard  deviation  of  1.20  and  average  mean  of 
6.85,  the  system  falls  in  the  range  of  “Easy”.  This  is  an  indication  that  the  cybernated  clearance 
system  can  be  effectively  used  with  ease  for  completing  clearance  tasks. 

The  resources  in  time  consumed  in  completing  a  task  was  evaluated  in  terms  of  overall  relative 
efficiency.  Due  to  its  suitability  for  multi  tasks,  results  revealed  that  the  overall  relative  efficiency 
was  72.8%  -  which  indicates  that  the  developed  clearance  system  is  highly  efficient  in  executing 
clearance  tasks. 

Evaluation  ratings  for  the  usability  attribute  of  satisfaction  were  captured  in  Table  2,  the  average 
usability  satisfaction  mean  of  7.91  and  7.84  indicated  that  participants  found  the  system 
satisfactorily  easy  on  task  1  and  task  6.  The  average  satisfaction  mean  for  clearance  officials  was 
7.36  with  a  usability  level  of  “Easy”  -  another  indication  that  the  system  is  satisfactorily  easy  to 
use.  This  is  a  huge  relief  from  the  existing  rigorous  clearance  burden.  On  the  aspect  of  students,  an 
average  mean  of  7.61  portraying  their  satisfaction  level  with  the  “Easy”  usability  level.  They  now 
prefer  the  system  to  the  former  as  they  are  no  longer  saddled  with  the  rigorous  activities  of  moving 
from  one  clearance  office  to  another.  There  is  an  overall  indication  that  the  participants  of  this  study 
were  of  the  perception  that  the  system  is  satisfactorily  easy  to  use  with  an  average  mean  of  7.37 
with  a  standard  deviation  of  0.74. 

5.  Conclusion 

This  research  is  a  pioneer  study  in  evaluating  the  usability  of  web  portal  technologies  for  clearance 
activities  of  outgoing  students  of  tertiary  institutions.  Summarily,  the  results  obtained  revealed  that 
the  developed  clearance  system  is  effective,  efficient  and  satisfactorily  easy  to  use  -  that  is,  it  is 
usable,  can  be  used  and  very  useful  for  clearance  related  tasks.  In  the  light  of  usability,  web 
technologies  should  be  harnessed  to  develop  and  deploy  portal  systems  with  optimal  ease  for 
efficient  and  effective  use  to  enhance  stakeholder  productivity  and  facilitate  clearance  related 
services  for  graduating  students.  The  significance  of  this  study  will  act  as  a  signal  and  scale  for 
academic  institutions  to  gauge  their  investments  in  academic  web  portal  systems  and  also,  to  review 
usability  efforts  in  the  development  cycle. 
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